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TITLE OF THE INVENTION 
IMAGE SENSING METHOD, IMAGE SENSING APPARATUS, 
LENS CONTROL METHOD THEREFOR, AND STORAGE MEDIUM 

5 BACKGROUND OF THE INVENTION 

The present invention relates to an image 
sensing method, an image sensing apparatus, a lens 
control method therefor, and a storage medium storing 
a control program for controlling the image sensing 

10 apparatus . 

Fig. 5 shows the schematic arrangement of an 
inner focus type lens system in a conventional image 
sensing apparatus. Referring to Fig. 5, reference 
numeral 501 denotes a first stationary lens; 502, a 

15 zoom lens for zooming; 503, a stop for light amount 
adjustment; 504, a second stationary lens; 505, a 
focus lens (focus compensation lens) having both a 
focus adjustment function and a so-called compensation 
function of correcting the movement of a focal plane 

20 upon zooming; and 506 r the imaging plane of an image 
sensing element such as a CCD. 

In the lens system having the arrangement shown 
in Fig. 5, since the focus compensation lens 505 has 
both the compensation function and the focus 

25 adjustment function, the position of the focus 

compensation lens 505 to be focused on the imaging 
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plane 506 varies depending on the object distance even 
if the focal length remains the same. 

Fig. 6 shows the result obtained by changing the 
object distance at each focal length, and continuously 
5 plotting the position of the focus compensation lens 
505 to be focused on the imaging plane 506. Referring 
to Fig. 6, the ordinate indicates the position of the 
focus compensation lens 505; and abscissa, the focal 
length (the position of the zoom lens) . 
10 If one of the loci in Fig. 6 is selected in 

accordance with the object distance, and the focus 
compensation lens 505 is moved along the selected 
locus during zooming, zooming can be done without any 
blur . 

15 A front-element focus type lens system has a 

compensation lens independently of a zoom lens . The 
zoom lens and the compensation lens are coupled to 
each other through a mechanical cam ring. Assume that 
this cam ring has a knob for manual zooming, and the 

20 focal length is to be changed manually. In this case, 
the cam ring rotates following the movement of the 
knob, and the zoom lens and the compensation lens move 
along the cam groove of the cam ring. As long as the 
focus lens stays focused, no blur is caused by the 

25 above operation. 

In general , in control operation in the inner 



- 2 - 




focus type lens system having the above 
characteristics, a plurality of pieces of locus 
information shown in Fig. 6 are stored in advance, in 
some form, in the lens control microcomputer, and a 
5 locus (cam locus) is selected on the basis of the 

positions of the focus lens and the zoom lens, thereby 
zooming along the selected locus. 

To read out the position of the focus lens 
relative to the position of the zoom lens from the 

10 storage element and use it in lens control, the 

position of each lens must be read accurately to some 
degree. As is obvious from Fig. 6 as well, when the 
zoom lens moves at a constant speed or nearly constant 
speed, in particular, the slope of the locus of the 

15 focus lens changes from moment to moment with changes 
in focal length. This indicates that the moving speed 
and the slope of movement of the focus lens change 
from moment to moment. In other words, an actuator for 
the focus lens needs to have speed response 

20 characteristics with a high precision of 1 Hz to 
several hundred Hz . 

As an actuator, i.e., a focus lens driving motor, 
in an inner focus type lens system, which satisfies 
the above requirement, a stepping motor is generally 

25 used. The stepping motor rotates in perfect 

synchronization with step pulses output from the lens 
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control microcomputer or the like. Since the step 
angle of the motor per pulse is constant, high speed 
response characteristics, high stop precision, and 
high position precision can be obtained. 
5 When a stepping motor is to be used, since the 

rotational angle is constant with respect to the 
number of step pulses, these pulses can be used as an 
incremental encoder. Hence, no special position 
encoder is required . 

10 As described above, when zooming is to be 

performed by using a stepping motor while the object 
is kept in focus, the locus information in Fig. 6 must 
be stored in advance, in some form (loci themselves or 
a function using the lens position as a variable) , in 

15 the lens control microcomputer or the like, and the 
focus lens must be moved on the basis of the locus 
information read out in accordance with the position 
or moving speed of the zoom lens. 

Figs . 7 and 8 are views for explaining an 

20 example of conventional locus tracking methods . 

Fig. 7 shows the in- focus locus of the focus 
lens, accompanying the movement of the zoom lens, for 
each object distance. Each locus is specified by the 
zoom lens position, i.e., the focal length, and the 

25 focus lens position, i.e., the object distance. The 
object can be maintained in focus during zooming by 
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driving the focus lens along the locus . 

Fig. 8 shows how the cam locus information in 
Fig. 7 is stored in the lens control microcomputer (or 
external memory) . Referring to Fig. 8, a variable v 
5 indicates the focus lens position (zone) in the object 
distance direction, and a variable n indicates the 
zoom lens position (zone) in the focal length 
direction. Data A(n, v) representing the focus lens 
position is specified by these pieces of information. 

10 Referring to Fig. 7, the ordinates indicates the 

focus lens position; and the abscissa, the zoom lens 
position (zO, zl, z2 , . . . , z6) . In addition, Ll(a0, al, 
a2,..., a6) and L3(b0, bl, b2 , . . . . , b6) are 
respectively the representative loci stored in the 

15 lens control microcomputer. L2(p0, pi, p2 , . . . , p6) is 
the locus calculated on the basis of the above two 
loci Ll and L3 by 



Figs. 7 and 8, when the focus lens is located at pO, 
the ratio at which pO internally divides a line 
segment bO - aO is obtained, and a point that 
internally divides a line segment bl - al at the 
25 obtained ratio is defined as pi. The moving speed of 
the focus lens at which an- in- focus state is 



p(n+l) = |p(n) - a(n)|/|b(n) - a(n)|x|b(n 
+ 1) - a(n+l) | + a(n+l) 



. . . (1) 



20 



According to equation (1) , in the case shown in 
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maintained can be obtained from the difference in 
position between the points pi and pO and the time 
required for the zoom lens to move from zO to zl. 

Consider a case in which the zoom lens need not 
5 stop on only boundaries having the stored 
representative locus data. 

Fig. 9 is a graph for explaining interpolation 
in the zoom lens position direction. This graph shows 
a portion of Fig. 7 with arbitrary zoom lens positions. 

10 Referring to Fig. 9, the ordinate indicates the 

focus lens position, and the abscissa, the zoom lens 
position (Zk-1, Zx, Zk) . In addition, Ll(bk-1, bx, bk) , 
L2(pk-1, px, pk) , and L3(ak-1, ax, ak) indicate the 
representative loci (focus lens positions relative to 

15 zoom lens positions) stored in the lens control 

microcomputer. When the zoom lens positions are ZO, 
Zl, . . . , Zk-1, Zk, . . . , Zn, the corresponding focus lens 
positions for the respective object distances are: 
aO, al, . . . , ak-1, ak, . . . , an 

20 bO, bl,..., bk-1, bk, . . . , bn 

When the current zoom lens position is the 
position Zx, which is not on a zoom boundary, and the 
current focus lens position is the position px, ax and 
bx are given by: 

25 ax = ak - (Zk - Zx) x (ak - ak-1) / (Zk - Zk-1) 
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bx = bk - (Zk - Zx) x (bk - bk-l)/(Zk - Zk-1) 

... (3) 

That is, ax and bx can be obtained by internally 
dividing data of the four stored representative locus 
5 data (ak, ak-1, bk, and bk-1 in Fig. 9), which are 

obtained at the same object distance, at the internal 
ratio obtained from the current zoom lens position and 
O two zoom boundary positions (e.g., Zk and Zk-1 in 

!U Fig. 9) on the two sides of the current zoom lens 

l;fi 10 position. Then, pk and pk-1 can be obtained by 

M internally dividing data of the four stored 

]. : representative data (ak, ak-1, bk, and bk-1 in Fig. 9), 

h§ which are obtained at the same focal length, at the 

: % internal ratio obtained from ax, px, and bx, as per 

5, !f 15 equation (1) . When zooming is to be performed from the 

wide-angle side to the telephoto side, the moving 
speed of the focus lens at which an in-focus state is 
maintained can be obtained from the difference in 
position between the destination focus position pk and 
20 the current focus position px and the time required 

for the zoom lens to move from Zx to Zk. When zooming 
is to be performed from the telephoto side to the 
wide-angle side, the moving speed of the focus lens at 
which an in-focus state is maintained can be obtained 
25 from the difference in position between the target 

focus position pk-1 and the current focus position px 
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and the time required for the zoom lens to move from 
Zx to Zk-1. 

The above locus tracking method has been 
proposed. 

5 Again, as is apparent from Fig. 6, in particular, 

when the zoom lens moves from the telephoto side to 
the wide-angle side, the object can be maintained in 
focus by the above locus tracking method. When, 
however, the zoom lens moves from the wide-angle side 

10 to the telephoto side, since a specific locus which 

the focus lens at a convergence point should track is 
not known, an in- focus state cannot be maintained by 
the same locus tracking method. 

Figs. 10A and 10B are graphs for explaining an 

15 example of locus tracking which has been proposed to 
solve the above problem. Referring to Fig. 10A, the 
ordinate indicates the high-frequency component 
(sharpness signal) of a luminance signal, i.e., an AF 
evaluation signal, in the vertical sync period, and 

20 the abscissa, the position of the zoom lens. Referring 
to Fig. 10B, the ordinate indicates the position of 
the focus lens; and the abscissa, the position of the 
zoom lens . 

Referring to Fig. 10A, reference numeral 1001 
25 denotes the maximum value of the level of the 

sharpness signal; 1002, the minimum value (TH1) of the 
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level of the sharpness signal; and 1003, the level of 
the sharpness . 

Referring to Fig. 10B, reference numerals 1004 
and 1005 denote cam loci; and 1006, the zoom lens 
5 position. 

Assume that the cam locus 1004 in Fig. 10B is a 
focus cam locus in zooming for a given object. Assume 
that the focus cam locus tracking speeds on the wide- 
angle side relative to the zoom lens position 1006 

10 (Z14) are positive (in the direction of the closest 

focusing distance of the focus lens) , and the in-focus 
cam tracking speeds on the telephoto side relative to 
the zoom lens position 1006 (Z14) on which the lens 
moves toward infinity are negative. Admittedly, when 

15 the focus lens moves along the focus cam locus 1004 
while it stays focused, the level of the above 
sharpness signal becomes almost constant. 

The moving speed of the focus lens that traces 
the focus cam locus 1004 in Fig. 10B in zooming is 

20 represented by VfO, and the actual moving speed of the 
focus lens is represented by Vf . When zooming is 
performed while the moving speed Vf of the focus lens 
is changed with respect to the moving speed VfO of the 
focus lens that traces the focus cam locus 1004, the 

25 resultant cam locus becomes the zigzag cam locus 1005. 
At this time, the level of the sharpness signal 
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changes to produce valleys and crests, as indicated by 
"1003" in Fig. 10A. At each point of intersection of 
the cam loci 1004 and 1005, the level 1003 of the 
sharpness signal becomes maximum (even points of Z0, 
5 Zl, . . . , Z16) . At each odd point of Z0, Zl, . . . , Z16, at 
which the moving direction vector of the cam locus 
1005 is switched, the level 1003 of the sharpness 
signal becomes minimum. 

Referring to Fig. 10A, although reference 

10 numeral 1002 denotes the minimum value (TH1) of the 
level 1003 of the sharpness signal, a minimum value 
(TH1) 1002 may be set for the level 1003 of the 
sharpness signal, and the moving direction vector of 
the cam locus 1005 in Fig. 10B may be switched every 

15 time the level 1003 of the sharpness signal becomes 

the minimum value (TH1) 1002. With this operation, the 
moving direction of the focus lens upon switching can 
be set in a direction in which the lens approaches the 
focus cam locus 1004 in Fig. 10B. 

20 That is, zooming with less blur amount can be 

performed by controlling the moving direction and 
speed of the focus lens to reduce blur every time an 
image blurs by the difference between the maximum 
level 1001 and minimum level (TH1) 1002 of the 

25 sharpness signal. 

With the use of the above method, in zooming 
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from the wide-angle side to the telephoto side, in 
which the cam loci in Fig. 6 diverge from a 
convergence point, a locus along which the level 1003 
of the sharpness signal does not become lower than the 
5 minimum value (TH1) 1002 in Fig. 10A, i.e., blur does 
not occur beyond a predetermined amount, can be 
selected by repeating switching operation (in 
accordance with changes in the level of the sharpness 
signal) , like the cam locus 1005 in Fig. 10B, while 

10 controlling the moving speed Vf of the focus lens with 
respect to the tracking speed described in the prior 
art (calculated by using p(n+l) obtained from equation 
(1) ) even if the focusing speed Vf 0 is unknown. 

In this case, the moving speed Vf of the focus 

15 lens is given by: 

Vf = Vf 0 + Vf+ ... (4) 

Vf = Vf 0 + Vf- ... (5) 

where Vf+ is the correction speed in the positive 
direction, and Vf- is the correction speed in the 

20 negative direction. 

In this case, to prevent offsets in locus 
tracking operation by the above zooming method, the 
correction speeds Vf+ and Vf- are determined such that 
the internal angle the two direction vectors of the 

25 moving speed Vf of the focus lens, which are obtained 
from equations (4) and (5) , make with each other is 
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equally divided into two by the direction vector of 
the moving speed VfO of the focus lens that traces the 
focus cam locus 1004. In addition, a technique of 
improving locus selection precision by changing the 
5 magnitudes of the correction speeds in accordance with 
focal length and depth of field has also been proposed. 
In addition, a method of tracking a locus by using an 
integral signal that sensitively changes with blur in 
place of a sharpness signal has been proposed. 

10 In the prior art described above, the sharpness 

signal is the high-frequency component of a video 
signal. At a shutter speed of 1/60 sec in the general 
NTSC scheme, a video signal can be obtained in each 
vertical sync period, as shown in Fig. 11A. When, 

15 however, the shutter speed decreases, and the charge 
storage time of the image sensing element 506 is 
prolonged, for example, when a shutter speed of 1/3 0 
sec is set as shown in Fig. 11B, a signal stored in 
the image sensing element 506 for 1/30 sec becomes a 

20 video signal. Therefore, a video signal is detected 
once per every 1/30 sec, i.e., once per every two 
vertical sync periods. That is, no video signal is 
detected once per every two vertical sync periods. At 
a shutter speed of 1/15 sec, a video signal is 

25 detected only once per every four vertical sync 
periods . 
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Figs . 12A to 12D show the relationship between 
the sharpness signal and the elapsed time at a shutter 
speed of 1/15 sec in an in-focus state in which the 
positions of an object and the focus lens remain the 
5 same. Fig. 12A shows a vertical sync signal; Fig. 12B, 
timing information from shutter speed control; 
Fig. 12C, a video signal; and Fig. 12D, a sharpness 
signal . 

As can be seen from Figs. 12A to 12D, the level 

10 of the sharpness signal changes even as the lens stays 
focused. According to the method of controlling the 
moving direction and speed of the focus lens to reduce 
blur every time an image blurs by the difference 
between the maximum value 1001 and minimum value (TH1) 

15 1002 of the level 1003 of the sharpness signal in 
Figs. 10A and 10B as in zooming operation, zooming 
operation following the object is realized in 
accordance with the difference information between the 
maximum value 1001 and minimum valuie (THl) 1002 of the 

20 sharpness signal level 1003. When the shutter speed is 
low, e.g., 1/15 sec, information of the minimum value 
(THl) 1002, from which a sharpness signal is obtained, 
is obtained once per every four vertical sync periods. 
That is, the period at which the direction is changed 

25 following the object is prolonged. As a result, the 
object cannot be tracked during zooming. 
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In addition, multiple speed zooming has recently 
become popular, and hence the zoom speeds vary from 
low-speed zooming to high-speed zooming. In this case 
as well, the focal plane must track an object to be 
5 photographed during zooming. 

Since the sharpness integral signal of an AF 
evaluation signal is a value obtained by adding 
sharpness peak signals in a horizontal sync period 
together within a vertical sync period, changes in 

10 evaluation signal are also integrated and appear owing 
to noise caused by camera shakes or the like during 
low-speed zooming. For this reason, whether a given 
change is a change in evaluation signal due to a focus 
lens tracking error during zooming or a change due to 

15 noise or the like cannot be determined. As a result, 
the focal plane cannot accurately track the object 
during zooming . 

Furthermore, in high-speed zooming, since the 
view angle changes steeply, whether a given change is 

20 a change in evaluation signal due to a focus lens 
tracking error during zooming or a change in view 
angle cannot be determined. As a result, the focal 
plane cannot accurately track the object during 
zooming . 
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SUMMARY OF THE INVENTION 



The present invention has been made in 
consideration of the problems in the prior art 
described above, and has as its object to provide an 
5 image sensing method and apparatus which can select a 
focus cam locus and perform focus tracking without 
blur in zooming from the wide-angle side on which no 
focus cam locus is determined to the telephoto side in 
slow shutter operation. 
10 It is another object of the present invention to 

provide a storage medium which stores a control 
program capable of smoothly controlling an image 
sensing apparatus of the present invention. 



15 invention to allow a camera or the like which uses 

multiple speed zooming from low-speed zooming to high- 
speed zooming to make the focal plane accurately track 
an object to be photographed during zooming operation 
regardless of zoom the speeds . 

20 It is still another object of the present 

invention to make the focal plane accurately track an 
object to be photographed during zooming operation in 
accordance with the presence/absence of internal noise 
such as noise resulting from camera shakes which are 

25 likely to occur during low- speed zooming or another 



It is still another object of the present 



factor. 
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In order to solve the above problems and achieve 
the above objects, an image sensing method according 
to its first aspect of the present invention is 
characterized by the following arrangement. 
5 The method comprises the zooming step of 

performing zooming operation, the shutter speed 
control step of controlling a timing of a charge 
storage time of an image sensing element, and the 
control step of controlling to change a zoom speed in 
10 the zooming step in accordance with a shutter speed. 

An image sensing apparatus according to its 
first aspect of the present invention is characterized 
by the following arrangement. 

The apparatus comprises zooming means for 

15 performing zooming operation, shutter speed control 

n 

means for controlling a timing of a charge storage 
time of an image sensing element, and control means 
for controlling to change a zoom speed of the zooming 
means in accordance with a shutter speed. 
20 An image sensing method according to its second 

aspect of the present invention is characterized by 
the following arrangement. 

The method comprises the zooming step of 
performing zooming operation using a zoom lens, the 
25 focus adjustment step of correcting movement of a 

focal plane upon movement of the zoom lens by using a 
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focus lens, the driving step of independently moving 
the zoom lens and the focus lens parallel to an 
optical axis, the selection step of selecting a charge 
storage time of an image sensing element, the shutter 
5 speed control step of controlling a timing of the 

charge storage time of the image sensing element, and 
the control step of controlling to change a zoom speed 
in the zooming step in accordance with a shutter speed. 
An image sensing apparatus according to its 

10 second aspect of the present invention is 

characterized by the following arrangement. 

The apparatus comprises zooming means for 
performing zooming operation using a zoom lens, focus 
adjustment means for correcting movement of a focal 

15 plane upon movement of the zoom lens by using a focus 
lens, driving means for independently moving the zoom 
lens and the focus lens parallel to an optical axis, 
an image sensing element, selection means for 
selecting a charge storage time of the image sensing 

20 element, shutter speed control means for controlling a 
timing of the charge storage t ime of the image sensing 
element, and control means for controlling to change a 
zoom speed of the zooming means in accordance with a 
shutter speed. 

25 A storage medium according to its first aspect 

of the present invention is characterized by the 
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following arrangement. 

The storage medium stores a control program for 
controlling an image sensing apparatus including 
zooming means for performing zooming operation, 
5 shutter speed control means for controlling a timing 
of a charge storage time of an image sensing element, 
and control means for controlling a zoom speed of the 
O zooming means , wherein the control program has a 

control module for the step of controlling to change 
10 the zoom speed of the zooming means in accordance with 
a shutter speed. 

A storage medium according to its second aspect 
of the present invention is characterized by the 
following arrangement . 
15 The storage medium stores a control program for 

controlling an image sensing apparatus comprising 
zooming means for performing zooming operation using a 
zoom lens, focus adjustment means for correcting 
movement of a focal plane upon movement of the zoom 
20 lens by using a focus lens, driving means for 

independently moving the zoom lens and the focus lens 
parallel to an optical axis, an image sensing element, 
selection means for selecting a charge storage time of 
the image sensing element, shutter speed control means 
25 for controlling a timing of the charge storage time of 
the image sensing element, and control means for 
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controlling a zoom speed of the zooming means, wherein 
the control program has a control module for the step 
of controlling to change the zoom speed of the zooming 
means in accordance with a shutter speed. 
5 An image sensing apparatus according to its 

third aspect of the present invention is characterized 
by the following arrangement. 
O The apparatus having an arrangement which can 

fy maintain an in- focus state by correcting a 

m 10 displacement of a focal plane during zooming operation 

r i : L comprises signal detection means for extracting a 

r:s=e 

high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
§ ^ signal, zoom speed detection means for detecting a 

^ 15 speed of the zooming operation, and evaluation value 

calculation means for changing a time during which the 
sharpness signals are averaged, during the zooming 
operation, in accordance with the speed of the zooming 
operation, and calculating a focus evaluation value 
20 during the zooming operation in the set averaging time. 
An image sensing apparatus according to its 
fourth aspect of the present invention is 
characterized by the following arrangement. 

The apparatus having an arrangement which can 
25 maintain an in-focus state by correcting a 

displacement of a focal plane during zooming operation 
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comprises signal detection means for extracting a 
high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, signal extraction means for extracting a 
5 luminance signal from the video signal obtained by 
photographing the object, and evaluation value 
calculation means for changing a time during which the 
p sharpness signals are averaged, during the zooming 

iy operation, in accordance with an object illuminance 

m 10 obtained from the luminance signal, and calculating a 

i;^ focus evaluation value during the zooming operation in 

"~ the set averaging time. 

bf: An image sensing apparatus according to its 

i « fifth aspect of the present invention is characterized 

15 by the following arrangement. 

The apparatus having an arrangement which can 
maintain an in-focus state by correcting a 
displacement of a focal plane during zooming operation 
comprises signal detection means for extracting a 
20 high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, shake detection means for detecting a shake of 
the image sensing apparatus, and evaluation value 
calculation means for changing a time during which the 
25 sharpness signals are averaged, during the zooming 
operation, in accordance with information from the 
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shake detection means, and calculating a focus 
evaluation value during the zooming operation in the 
set averaging time . 

An image sensing apparatus according to its 
5 sixth aspect of the present invention is characterized 
by the following arrangement. 

The apparatus comprises a first lens group for 
zooming operation, a second lens group for correcting 
movement of a focal plane during movement of the first 

10 lens group, signal detection means for extracting a 

high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, zoom speed detection means for detecting a 
speed of the zooming operation, storage means for 

15 storing information of a focus position of the second 
lens group relative to a position of the first lens 
group in correspondence with an object distance, 
moving speed calculation means for obtaining a 
standard moving speed of the second lens group upon 

20 movement of the first lens group on the basis of the 
information stored in the storage means, speed 
addition means for adding a correction speed to the 
standard moving speed of the second lens group, 
obtained by the moving speed calculation means, during 

25 the zooming operation, and focus control means for 

changing a time during which the sharpness signals are 



- 21 - 



averaged, during the zooming operation, in accordance 
with the speed of the zooming operation, calculating a 
focus evaluation value during the zooming operation in 
the set averaging time, and changing the correction 
5 speed to be added to the standard moving speed in 
accordance with a magnitude of the calculated focus 
evaluation value. 

An image sensing apparatus according to its 
seventh aspect of the present invention is 

10 characterized by the following arrangement. 

The apparatus comprises a first lens group for 
zooming operation, a second lens group for correcting 
movement of a focal plane during movement of the first 
lens group, signal detection means for extracting a 

15 high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, signal extraction means for extracting a 
luminance signal from the video signal obtained by 
photographing the object, storage means for storing 

20 information of a focus position of the second lens 

group relative to a position of the first lens group 
in correspondence with an object distance, moving 
speed calculation means for obtaining a standard 
moving speed of the second lens group upon movement of 

25 the first lens group on the basis of the information 
stored in the storage means, speed addition means for 
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adding a correction speed to the standard moving speed 
of the second lens group, obtained by the moving speed 
calculation means, during the zooming operation, and 
focus control means for changing a time during which 
5 the sharpness signals are averaged, during the zooming 
operation, in accordance with an object illuminance 
obtained from the luminance signal, calculating a 
focus evaluation value during the zooming operation in 
the set averaging time, and changing the correction 

10 speed to be added to the standard moving speed in 

accordance with a magnitude of the calculated focus 
evaluation value . 

An image sensing apparatus according to its 
eighth aspect of the present invention is 

15 characterized by the following arrangement. 

The apparatus comprises a first lens group for 
zooming operation, a second lens group for correcting 
movement of a focal plane during movement of the first 
lens group, signal detection means for extracting a 

20 high-frequency component from a video signal obtained 
by photographing an object, and detecting a sharpness 
signal, shake detection means for detecting a shake of 
the image sensing apparatus, storage means for storing 
information of a focus position of the second lens 

25 group relative to a position of the first lens group 
in correspondence with an object distance, moving 
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speed calculation means for obtaining a standard 
moving speed of the second lens group upon movement of 
the first lens group on the basis of the information 
stored in the storage means, speed addition means for 
5 adding a correction speed to the standard moving speed 
of the second lens group, obtained by the moving speed 
calculation means, during the zooming operation, and 
focus control means for changing a time during which 
the sharpness signals are averaged, during the zooming 

10 operation, in accordance with information from the 

shake detection means, calculating a focus evaluation 
value during the zooming operation in the set 
averaging time, and changing the correction speed to 
be added to the standard moving speed in accordance 

15 with a magnitude of the calculated focus evaluation 
value . 

A lens control method according to its first 
aspect of the present invention is characterized by 
the following arrangement. 

20 The method is used in an image sensing apparatus 

including a first lens group for zooming operation and 
a second lens group for correcting movement of a focal 
plane during movement of the first lens group and 
adapted to control movement of the second lens group 

25 so as to maintain an in- focus state by correcting a 
displacement of a focal plane upon movement of the 
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first lens group during zooming operation, comprising 
the steps of averaging sharpness signals corresponding 
to a predetermined time, each generated by extracting 
a high-frequency component from a video signal 
5 obtained by photographing an object, and calculating a 
focus evaluation value for determining a moving speed 
of the second lens group on the basis of the averaged 
j;3 sharpness signal, and changing the averaging time of 

ry the sharpness signals during the zooming operation in 

j ; fi 10 accordance with a speed of the zooming operation. 

A lens control method according to its second 
"~ aspect of the present invention is characterized by 

!;f! the following arrangement. 

The method is used in an image sensing apparatus 
-fl 15 including a first lens group for zooming operation and 

a second lens group for correcting movement of a focal 
plane during movement of the first lens group and 
adapted to control movement of the second lens group 
so as to maintain an in-focus state by correcting a 
20 displacement of a focal plane upon movement of the 

first lens group during zooming operation, comprising 
the steps of averaging sharpness signals corresponding 
to a predetermined time, each generated by extracting 
a high-frequency component from a video signal 
25 obtained by photographing an object, and calculating a 
focus evaluation value for determining a moving speed 
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of the second lens group on the basis of the averaged 
sharpness signal, and changing the averaging time of 
the sharpness signals during the zooming operation in 
accordance with an object illuminance obtained from a 
5 luminance signal in the video signal obtained by 
photographing the object. 

A lens control method according to its third 
q aspect of the present invention is characterized by 

i ; y the following arrangement. 

s «~ 10 The method is used in an image sensing apparatus 

JjT including a first lens group for zooming operation and 

5=== a second lens group for correcting movement of a focal 

plane during movement of the first lens group and 
i« adapted to control movement of the second lens group 

M3 15 so as to maintain an in-focus state by correcting a 

displacement of a focal plane upon movement of the 
first lens group during zooming operation, comprising 
the steps of averaging sharpness signals corresponding 
to a predetermined time, each generated by extracting 
20 a high-frequency component from a video signal 

obtained by photographing an object, and calculating a 
focus evaluation value for determining a moving speed 
of the second lens group on the basis of the averaged 
sharpness signal, and changing the averaging time of 
25 the sharpness signals during the zooming operation in 
accordance with information from shake detection means 
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for detecting a shake of the image sensing apparatus . 

Other objects and advantages besides those 
discussed above shall be apparent to those skilled in 
the art from the description of a preferred embodiment 
5 of the invention which follows. In the description, 

reference is made to accompanying drawings, which form 
a part hereof, and which illustrate an example of the 
p invention. Such example, however, is not exhaustive of 

j ; Q the various embodiments of the invention, and 

m 10 therefore reference is made to the claims which follow 

the description for determining the scope of the 
s '~ invention. 

iw r BRIEF DESCRIPTION OF THE DRAWINGS 

15 Fig. 1 is a block diagram showing the 

".■err 

arrangement of an image sensing apparatus according to 
the first embodiment of the present invention; 

Fig. 2 is a flow chart showing a procedure for 
lens control operation in the image sensing apparatus 
20 according to the first embodiment of the present 
invention ; 

Fig. 3 is a flow chart showing a procedure for 
lens control operation in the image sensing apparatus 
according to the first embodiment of the present 
25 invention; 

Fig. 4 is a graph showing the relationship 
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between the focus lens position and the zoom lens 
position; 

Fig, 5 is a view showing the arrangement of an 
inner focus type lens system in a conventional image 
5 sensing apparatus; 

Fig. 6 is a graph showing the relationship 
between the focus lens position and the focal length 
(zoom lens position) ; 

Fig. 7 is a graph showing the in- focus locus 
10 (cam locus) of the focus lens at movement of the zoom 
lens for each object distance; 

Fig. 8 is a view showing how the cam locus 
information in Fig. 7 is stored in a lens control 
microcomputer (or external memory) ; 
15 Fig. 9 is a view showing the relationship 

between the focus lens position and the zoom lens 
position; 

Figs. 10A and 10B are graphs for explaining an 
example of conventional locus tracking methods; 
20 Figs. 11A and 11B are timing charts showing the 

relationship between shutter speeds and video signals; 

Figs . 12A to 12D are timing charts showing the 
relationship between shutter speeds and signals; 
Fig. 13 is a block diagram showing the 
25 arrangement of an image sensing apparatus according to 
the third to fifth embodiments of the present 
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invention; 

Figs. 14A and 14B are views respectively showing 
the arrangement and characteristics of a zoom switch; 

Fig. 15 is a flow chart showing a procedure for 
5 control operation performed by an AF microcomputer 
according to the third to sixth embodiments; 

Fig. 16 is a flow chart showing a procedure for 
control operation performed by the AF microcomputer 
according to the third embodiment, and more 
10 specifically, processing for the zooming routine in 
Fig. 15; 

Fig. 17 is a flow chart showing a procedure for 
control operation performed by an AF microcomputer 
according to the fourth embodiment, and more 
15 specifically, processing for the zooming routine in 
Fig. 15; 

Fig. 18 is a flow chart showing a procedure for 
control operation performed by an AF microcomputer 
according to the fifth embodiment, and more 
20 specifically, processing for the zooming routine in 
Fig. 15; 

Fig. 19 is a block diagram showing the 
arrangement of an image sensing apparatus according to 
the sixth embodiment of the present invention; and 
25 Fig. 20 is a flow chart showing a procedure for 

control operation performed by an AF microcomputer 
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according to the sixth embodiment, and more 
specifically, processing for the zooming routine in 
Fig. 15. 

5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Each embodiment of the present invention will be 
described below with reference to the accompanying 
drawings . 
(First Embodiment) 

10 The first embodiment of the present invention 

will be described first with reference to Figs. 1 to 4 . 

Fig. 1 is a block diagram showing the 
arrangement of an image sensing apparatus according to 
the first embodiment of the present invention. 

15 Referring to Fig. 1, reference symbol LS denotes an 
inner focus type lens system. This lens system LS 
includes the following constituent elements: a 
stationary first lens group 101, a zoom lens (first 
lens group) 102 for optical zooming, a stop 103 for 

20 light amount adjustment, a stationary second lens 

group 104, and a focus lens (second lens group) 105 
having both a compensation function and a focusing 
function. Video light transmitted through the lens 
system LS forms an image on the surface of an image 

25 sensing element 106 (to be described later) to be 
photoelectrically converted into a video signal. 
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Reference numeral 106 denotes an image sensing 
element (CCD) for converting a light signal into an 
electrical signal; 107, a first amplifier (or 
impedance converter) for amplifying the video signal 
5 output from the image sensing element 106; 108, a 
camera signal processing circuit for performing 
predetermined processing for the video signal output 
from the image sensing element 106; 109, a second 
i-H amplifier for amplifying the video signal processed by 

%l 10 the camera signal processing circuit 108 to a 

:J predetermined level; 110, an LCD control circuit for 

r== controlling a display (LCD: Liquid Crystal Display) 

|;H (to be described later); and 111, a display (LCD: 

!U Liquid Crystal Display) for displaying information. 

*.B 15 Reference numeral 112 denotes a stop control 

circuit; 113, an IG driver; 114, an IG meter; 115, an 
AF evaluation value processing circuit; and 116, a 
distance measuring frame generating circuit. The video 
signal amplified by the first amplifier 107 is sent to 
20 the stop control circuit 112 and the AF evaluation 

value processing circuit 115. The stop control circuit 
112 drives the IG driver 113 and the IG meter 114 to 
control the stop 103 in accordance with the video 
signal input level, thereby performing light amount 
25 adjustment. The AF evaluation value processing circuit 
115 extracts a high-frequency component from a 
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luminance signal within the distance measuring frame 
in accordance with a gate signal from the distance 
measuring frame generating circuit 116. 

Reference numeral 117 denotes a lens control 
5 microcomputer for performing drive control of the lens 
and distance measuring control for a change of the 
distance measuring area in accordance with the 
strength of an AF evaluation signal. In addition, the 
lens control microcomputer 117 communicates with a 

10 system control microcomputer (system controller) 118 
to exchange information from a zoom switch (zoom SW) 
119, which is read by the system controller 118 upon 
A/D conversion or the like, and zooming information 
such as a zoom direction and a focal length in zooming 

15 operation controlled by the lens control microcomputer 
117. The zoom SW 119 takes the form of a unit. A 
voltage corresponding to the rotational angle of an 
operation member (not shown) is output from the zoom 
SW 119. Variable speed zooming is performed in 

20 accordance with this output voltage. 

Reference numeral 120 denotes a zoom motor for 
driving the zoom lens 102; 121, a focus motor for 
driving the focus lens 105; 122, a zoom driver for 
outputting driving energy to the zoom motor 12 0 in 

25 accordance with a drive instruction output for the 

zoom lens 102 from the lens control microcomputer 117; 
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and 123, a focus driver for outputting driving energy 
to the zoom driver 122 in accordance with a drive 
instruction output for the focus lens 105 from the 
lens control microcomputer 117. 
5 Reference numeral 124 denotes a shutter speed 

selector for selecting the shutter speed; 125, a 
shutter speed controller for controlling the shutter 
^ speed; and 126, a CCD driving circuit for driving the 

image sensing element 106. 
10 The shutter speed data selected by the shutter 

: i F speed selector 124 is input to the shutter speed 

H controller 125 to set the charge storage time for the 

O image sensing element 106 in accordance with the 

!y shutter speed. The charge storage timing data for the 

ih 15 image sensing element 106 controlled by the shutter 

speed controller 125 is input to the camera signal 
processing circuit 108 and the lens control 
microcomputer 117 . 

A method of driving the zoom motor 120 and the 
20 focus motor 121 will be described next, assuming that 
these motors are stepping motors . 

The lens control microcomputer 117 determines 
the driving speeds for the zoom motor 120 and the 
focus motor 121 by program processing, and sends the 
25 speeds as rotational frequency signals for the motors 
120 and 121 to the zoom driver 122 and the focus 
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driver 123, respectively. The lens control 
microcomputer 117 also sends drive/stop instruction 
signals and rotating direction instruction signals for 
the motors 120 and 121 to the drivers 122 and 123. 
5 The drive/stop instruction signal and rotating 

direction instruction signal for the zoom motor 120 
mainly correspond to the state of the zoom SW 119. 
?3 Such signals for the focus motor 121 correspond to 

i=y drive instructions determined within the lens control 

10 microcomputer 117 in AF (Automatic Focus) processing 
and zooming. Each of the drivers 122 and 123 sets the 
|:K= four motor exciting phases to forward and reverse 

rotation phases in accordance with the rotating 
S'U direction instruction signal, and outputs voltages 

U3 15 (currents) for the four motor exciting phases while 

changing them in accordance with the received 
rotational frequency signal, thereby ON/OFF- 
controlling the output to each of the motors 120 and 
121 in accordance with the drive/stop instruction 
20 signal while controlling the rotating direction and 

rotational frequency of each of the motors 12 0 and 121. 

The operation of the image sensing apparatus 
according to this embodiment will be described next 
with reference to Fig. 2. 
25 Fig. 2 is a flow chart showing a procedure 

followed by the image sensing apparatus according to 
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this embodiment. The control flow chart shown in 
Fig. 2 is processed in the lens control microcomputer 
117. 

Step S201 is an initialization routine, in which 
5 a RAM (Random- Access Memory) and various types of 
ports in the lens control microcomputer 117 are 
initialized. Step S202 is a communication routine, in 
which information from the zoom SW 119 and zooming 
information such as the position of the zoom lens 102 

10 are exchanged. Step S203 is a sharpness signal 

processing routine, in. which the sharpness signal of 
an AF evaluation signal is processed in accordance 
with the signal obtained from the AF evaluation value 
processing circuit 115. Step S204 is an AF processing 

15 routine, in which automatic focus adjustment is 
performed in accordance with a change in the AF 
evaluation signal . 

Step S205 is a zooming routine, which is a 
compensation processing routine for maintaining an in- 

20 focus state in zooming operation. In this routine, the 
driving direction and speed for the focus lens 105 are 
calculated so as to trace a cam locus like the one 
shown in Fig. 6. This calculation method will be 
described in detail later. Step S206 is a driving 

25 direction and speed selection routine, in which 

driving directions and speeds to be used are selected 
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from those calculated for the zoom lens 102 and focus 
lens 105 in steps S204 and S205 in accordance with the 
AF (Automatic Focus) mode, zooming operation, or the 
like so as to prevent the lenses from exceeding the 
5 telephoto end, wide-angle end, closest focusing 

distance, and infinity, which are set by software, 
thereby preventing the lenses from bumping against the 
lens mechanical ends . 

Step S207 is a routine for performing drive 

10 control on the zoom motor 120 and the focus motor 121. 
In this routine, control signals are output to the 
zoom motor 120 and the focus motor 121 in accordance 
with the data selected in step S206, thereby 
controlling the driving /stopping of the zoom lens 102 

15 and the focus lens 105. Upon completion of the 

processing in step S207, the flow returns to step S202. 

A series of operations in Fig. 2 is executed in 
synchronism with a vertical sync period (a standby 
state continues until the next vertical sync signal 

20 arrives in the processing in step S202). 

The zooming routine in step S205 in Fig. 2 will 
be described in detail next with reference to Fig. 3. 

Fig. 3 is a flow chart showing a procedure for 
the zooming routine in step S205 in Fig. 2. 

25 When the AF processing routine in step S204 in 

Fig. 2 is complete, the zoom speed is set in 
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accordance with information from the zoom SW 119, 
which is obtained upon communication with the system 
controller 118, and a reverse flag is set to 0 in step 
S301 in Fig. 3. In step S302, it is checked, on the 
5 basis of information from the shutter speed selector 
124 in Fig. 1, whether the shutter speed is higher 
than a given speed SP. If YES in step S3 02, it is 
checked in step S3 03 whether zooming is being 
performed. If YES in step S303, a standard cam locus 

10 is set from the positions of the zoom lens 102 and 
focus lens 105 at this time and a stored 
representative cam table to zoom in step S304. 

Referring to Fig. 7, letting pO be the current 
position, the ratio obtained by internally dividing a 

15 line segment bO - a ((3) with pO is given by 
pO - aO/bO - aO = a/(3 
Referring to Fig. 8, since a0 = A(0, 0) and bO = A(l, 
0) , a locus is obtained by connecting points that 
internally divide the distance defined by n = 0, 1 

20 with v = 0 at the ratio of a/(3 from the wide-angle 
side to the telephoto side (v=0, 1,..., s). A 
standard cam locus can therefore be set by calculating 
n, a, and P from the positions of the zoom lens 102 
and focus lens 105 at this time. A point pi is then 

25 calculated from the standard cam locus (n, a, (3) and 
the locus data stored in the lens control 
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microcomputer 117 according to equation (1) described 
in the prior art. A standard tracking speed VfO of the 
focus lens 105 is calculated by using the point pi. 

In step S3 05, correction speeds Vf+ and Vf- at 
5 which the focus lens 105 is driven in the + and - 

directions in Figs. 10A and 10B are calculated. These 
correction speeds Vf+ and Vf- are calculated as 
follows . 

Fig. 4 is a graph for explaining a method of 

10 calculating the correction speeds Vf+ and Vf-. 

Referring to Fig. 4, the ordinates indicates the 
position of the focus lens 105; and the abscissa, the 
position of the zoom lens 102. 

Referring to Fig. 4, reference numeral 1004 

15 denotes a cam locus to be traced. Assume that the 

focusing speed set when the position of the focus lens 
105 changes by a value y as the position of the zoom 
lens 102 changes by a value x is the standard speed 
VfO (denoted by reference numeral 403 in Fig. 4) , and 

20 the focusing speeds set when the position of the focus 
lens 105 changes by values n and m as the position of 
the zoom lens 102 changes by the value x are 
respectively the correction speeds Vf+ and Vf- to be 
obtained. In this case, the values n and m are 

25 determined such that a speed 401 in Fig. 4, which is 
obtained by adding the correction speed Vf+ to the 
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standard speed VfO and is used to drive the lens in 
the + direction, and a speed 402 in Fig. 4, which is 
obtained by adding the correction speed Vf- to the 
standard speed VfO and is used to drive the lens in 
5 the - direction, respectively have direction vectors 
separated from the direction vector of the standard 
speed VfO by an equal angle 7. 

First of all, the value n and m are obtained. 
From the graph of Fig . 4 , we have : 
10 tan0 = y/x, tan (9 - 7) = (y - m) /x, tan(0 + 7) 

= (y +n) /x ... (2) 

tan (9 ± 7) = (tanG* tarry) / (l±tan6« tarry) ... (3) 

According to equations (2) and (3), 
m = (x2 + y2) / (x/K + y) ... (4) 

15 n = (x2 + y2) / (x/k - y) ... (5) 

for tan7 = k 
The values n and m are calculated according to 
equations (2) and (3). 

If the position of the zoom lens 102 changes by 
20 the value x per unit time, the respective values can 
be defined as follows: zoom speed vz - x, standard 
focusing speed VfO = y, correction speed Vf+ - n, and 
correction speed Vf- = m. The correction speeds Vf+ 
and Vf- can be obtained from equations (4) and (5) . 
25 Referring to Fig. 3 again, it is checked in step 

S3 06 whether zooming is from the wide-angle side (W) 
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to the telephoto side (T) . If YES in step S306, it is 
checked in step S3 07 whether the current sharpness 
integral signal level is lower than a minimum value 
(TH1) . If YES in step S307 7 the. reverse flag is set at 
5 1 in step S308. It is then checked in step S309 

whether the reverse flag is set at 1 . If YES in step 
S3 09, it is checked in step S310 whether a correction 
flag is set at 1 . If YES in step S310, the correction 
flag is set at 0 (- direction) in step S311. 
10 focusing speed Vf = VfO - Vf- (VfO > 0) 

= VfO + Vf- (VfO < 0) 

for Vf- > 0 

After a speed vf2 is set for the focus motor 121 
in step S3 12, the zoom motor 120 and the focus motor 
15 121 are actually driven in steps S206 and S207 in 
Fig. 2. 

If it is determined in step S3 02 that the 
shutter speed is lower than the speed SP, the zoom 
speed set in step S3 01 is changed to a low speed in 

20 step S313, and the flow advances to step S303. If it 
is determined in step S3 03 that zooming is not being 
performed, the processing in Fig. 3 is terminated, and 
the zoom motor 120 and the focus motor 121 are 
actually driven in steps S206 and S207 in Fig. 2. 

25 If it is determined in step S306 that zooming is 

not from the wide-angle side (W) to the telephoto side 
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(T) , correction speed Vf+ = 0 and Vf- = 0 are set in 
step S314, and the flow advances to step S309. If it 
is determined in step S3 07 that the current sharpness 
integral signal level is equal to or higher than the 
5 minimum value (TH1) , the flow advances to step S309. 
If it is determined in step S3 09 that the 
reverse flag is not at 1, it is checked in step S3 15 
whether the correction flag is at 1. If NO in step 
S315 or S310, the correction flag is set at 1 ( + 
10 direction) in step S316. 

focusing speed Vf = VfO + Vf+ (VfO > 0) 

= VfO - Vf+ (VfO < 0) 

for Vf + > 0 

When the processing in step S3 16 is complete, 
15 the flow advances to step S312. 

As described above, when the focus position is 
unknown, and zooming is performed while the AF 
evaluation value is increased/decreased, the focus 
tracking performance at a low shutter speed, i.e., a 
20 speed lower than the normal shutter speed of 1/60 sec, 
can be improved by decreasing the zoom speed below the 
normal zoom speed. 
(Second Embodiment) 

The second embodiment of the present invention 
25 will be described next. 

As shown in Figs. 11A to 12D, at a shutter speed 
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of 1/60 sec or higher, a sharpness signal can be 
obtained every vertical sync period. At 1/30 sec, 
however, a sharpness signal is obtained every two 
vertical sync periods, and at 1/15 sec, a sharpness 
5 signal is obtained every four vertical sync periods. 
That is, as the shutter speed decreases, the period at 
which a sharpness signal is obtained is prolonged. If 
r3 the time required for zooming (zoom speed) from the 

3 ;H wide-angle side to the telephoto side remains the same, 

:;LJ 10 the AF evaluation (sharpness signal) obtained during 

zooming from the telephoto side to the wide-angle side 
|! * decreases as the shutter speed decreases. When, 

O therefore, the shutter speed is low, the same focus 

I : y tracking performance during zooming as that at a high 

vS 15 shutter speed can be obtained by decreasing the zoom 

speed in proportion to the shutter speed. 

If, therefore, it is determined in step S3 02 in 
Fig. 3 that the shutter speed is lower than a given 
speed SP, zooming operation that can track an object 
20 without blur can be performed, regardless of how low 
the shutter speed is, by setting the zoom speed in 
accordance with the shutter speed instead of resetting 
the zoom speed to a low speed. 

As described in detail above, according to the 
25 first and second embodiments, by determining the zoom 
speed in accordance with the shutter speed, object 
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focus tracking can be performed during zooming 
regardless of the shutter speed. 

In addition, when the shutter speed is lower 
than the normal speed, the object focus tracking 
5 performance during zooming can be improved by- 
decreasing the zoom speed. 

Furthermore, according to storage media of the 
first and second embodiments, an image sensing 
apparatus like the one described above can be smoothly 

10 controlled. 

(Third Embodiment) 

Fig. 13 is a block diagram showing the 
arrangement of an image sensing apparatus according to 
the third embodiment of the present invention. 

15 Referring to Fig. 13, reference numerals 601, 602, 603, 
604, and 605 respectively denote the building elements 
of an inner focus type lens system, and more 
specifically, a stationary front-element lens group, a 
second lens group for zooming, a stop, a third 

20 stationary lens group, and a fourth lens group having 
both a compensation function and a focusing function. 

Object light transmitted through this lens 
system forms an image on an image sensing element 606 
such as a CCD and photoelectrically converted into a 

25 video signal. This video signal is amplified by an 
amplifier or impedance converter 607 and input to a 
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camera signal processing circuit 608. The video signal 
having undergone predetermined signal processing is 
amplified to a prescribed level by an amplifier 609 
and processed by an LCD display circuit 610. The 
5 resultant signal is displayed as a photographic image 
on an LCD 611. 

The video signal amplified by the amplifier or 
impedance converter 607 is also sent to a stop control 
circuit 612 and an AF evaluation value processing 

10 circuit 615. The stop control circuit 612 drives an IG 
driver 613 and an IG meter 614 to control the stop 603 
in accordance with the input level of the video signal, 
thereby adjusting the light amount. The AF evaluation 
value processing circuit 615 extracts only the high- 

15 frequency component from the video signal within a 
distance measuring frame in accordance with a gate 
signal from a distance measuring frame generating 
circuit 617, and performs predetermined processing to 
generate an AF evaluation signal. 

20 Reference numeral 616 denotes an AF 

microcomputer for performing lens drive control and 
distance measuring frame control to change the 
distance measuring area in accordance with the 
strength of the AF evaluation signal supplied from the 

25 AF evaluation value processing circuit 615. In 

addition, the AF microcomputer 616 communicates with a 
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system control microcomputer (system controller) 622 
to exchange information from a zoom switch 623, which 
is loaded into the system controller 622 upon A/D 
conversion or the like, zooming information such as a 
5 zoom direction and focal length in zooming controlled 
by the AF microcomputer 616, and the like. 

The above zoom switch 623 takes the form of a 
unit. A voltage corresponding to the rotational angle 
of an operation member is output from the zoom SW 119 . 

10 Figs . 14A and 14B respectively show the arrangement of 
the zoom SW as a unit and its characteristics. As 
shown in Fig. 14A, the zoom switch 623 is comprised of 
a variable resistor to output a voltage in accordance 
with the rotational angle of the operation member. 

15 Variable speed zooming is done in accordance with the 
magnitude of this output voltage. 

Fig. 14B shows the relationship between the 
output voltage from the zoom SW and the variable zoom 
speed. Within the output voltage range, a zooming 

20 stopping zone is located near 2.5 V, i.e., the middle 
voltage. When the output voltage is lower than this 
voltage, zooming is performed in the wide-angle 
direction. The zoom speed increases with a decrease in 
the output voltage, and vice versa. When the output 

25 voltage is higher than the stopping voltage, zooming 
is performed in the telephoto direction. The zoom 
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speed increases with an increase in the output voltage, 
and vice versa. The output voltage and the zoom speed 
have a linear relationship in both the wide-angle and 
telephoto directions . 
5 Reference numeral 618 denotes a zoom lens driver 

for outputting driving energy to the lens driving 
motor in accordance with a drive instruction for the 
zoom lens 602 which is output from the AF 

jfj microcomputer 616; 621, a focus compensation lens 

i w 

J:L? 10 driver for outputting driving energy to the lens 

;>"F driving motor in accordance with a driving instruction 

M= for the focus lens 605 which is output from the AF 

Q microcomputer 616; and 619 and 620, lens driving 

jy motors for driving the zoom lens 602 and the focus 

est 

15 lens 605. 

'"^ A method of driving the motors will be described 

below, assuming that the lens driving motors are 
stepping motors. 

The AF microcomputer 616 determines the driving 

20 speeds for the zoom lens motor 619 and the focus 

compensation lens motor 621 by program processing, and 
sends the speeds as rotational frequency signals for 
the respective stepping motors to the zoom lens driver 
618 and the focus compensation lens driver 620, 

25 respectively. The AF microcomputer 616 also sends 
drive/stop instructions and rotating direction 
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instructions for the motors 619 and 621 to the drivers 
618 and 62 0. 

The drive/ stop instruction and rotating 
direction instruction for the zoom lens motor 619 are 
5 output mainly in accordance with the state of the zoom 
switch unit 623. Such signals for the focus 
compensation lens motor 621 are output in accordance 
with drive instructions determined within the AF 
microcomputer 616 in AF processing and zooming. Each 

10 motor driver sets the four motor exciting phases to 

forward and reverse rotation phases in accordance with 
the received rotating direction signal, and outputs 
voltages (currents) for the four motor exciting phases 
while changing them in accordance with the received 

15 rotational frequency signal, thereby ON/OFF- 

controlling the output to each motor in accordance 
with the drive/stop instruction while controlling the 
rotating direction and rotational frequency of each 
motor . 

20 Fig. 15 is a flow chart showing a procedure for 

executing the third embodiment. This processing is 
performed in the AF microcomputer 616. Step S701 is an 
initialization routine, in which a RAM and various 
types of ports (not shown) in the AF microcomputer 616 

25 are initialized. Step S702 is a communication routine, 
in which information from the zoom SW unit 623 and 
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zooming information such as a zoom lens position are 
exchanged . 

Step S703 is a sharpness signal processing 
routine, in which the sharpness signal of an AF 
5 evaluation signal is processed in accordance with the 
signal obtained from the AF evaluation value 
processing circuit 615. Step S704 is an AF processing 
routine, in which automatic focus adjustment is 
performed in accordance with a change in the AF 

10 evaluation signal processed in step S703. 

Step S705 is a zooming routine, in which 
compensation processing is performed to maintain an 
in-focus state in zooming operation. In this routine, 
the driving direction and speed for the focus lens 605 

15 are calculated to trace a cam locus like the one shown 
in Fig. 6. This operation will be described in detail 
later with reference to Fig. 16. 

In step S706, driving directions and speeds to 
be used are selected from those calculated for zooming 

20 and focusing in steps S704 and S705 in accordance with 
the AF mode, zooming operation, or the like so as to 
prevent the lenses from exceeding the telephoto end, 
wide-angle end, closest focusing distance, and 
infinity, which are set by software, thereby 

25 preventing the lenses from overshooting the lens 
mechanical ends . 
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In step SI 07 , control signals are output to the 
zoom lens driver 618 and the focus compensation lens 
driver 620 in accordance with the information about 
the driving directions and speeds for focusing which 
5 are determined in step S706, thereby controlling the 

driving/ stopping of the lenses. The control returns to 
step S702 after step S707. A series of operations in 
Fig. 15 is executed in synchronism with the vertical 
sync period (a standby state continues until the next 
10 vertical sync signal arrives in the processing in step 
;P S702). 

* : ~ Fig. 16 is a flow chart showing a procedure for 

lip executing the third embodiment, and more specifically, 

\U the contents of the processing in the subroutine in 

ih 15 step S705 in Fig. 15. 

First of all, in step S801, the zoom speed is 
set on the basis of the information from the zoom 
switch 623, which is obtained upon communication with 
the system controller 622, and a reverse flag is set 
20 to "0" . It is then checked in step S802 whether 

zooming is being performed. If NO in step S802, the 
flow goes out of the zooming routine. 

If it is determined in step S802 that zooming is 
being performed, the flow advances to step S803 to 
25 determine the standard cam locus on the basis of the 
positions of the zoom lens 602 and focus lens 605 at 
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this time and the contents of a representative cam 
locus table stored in advance. Referring to Fig. 7, 
letting pO be the current position of the focus lens 
605, the ratio obtained by internally dividing a line 
5 segment bO - a0((3) with a point pO is given by 
pO - aO/bO - aO = a/p 
Referring to Fig. 8, since aO = A00 and bO = A10, a 
■•g locus is obtained by connecting points that internally 

I-H divide the distance defined by n = 0, 1 with v = 0 at 

;Lr 10 the ratio of a/P from the wide-angle side to the 

telephoto side (v = 0, 1,..., s). A standard cam locus 
'■^ can therefore be set by calculating n, a, and p from 

3 the positions of the zoom lens 602 and focus lens 605 

U at this time. A point pi is then calculated from the 

h 15 standard cam locus (n, a, P) and the locus data stored 

in the AF microcomputer 616 according to equation (1) 
described in the prior art. A standard tracking speed 
VfO of the focus lens 605 is calculated by using the 
point pi . 

20 In step S804, correction speeds Vf+ and Vf- at 

which the focus lens 605 is driven in the + and - 
directions in Fig. 10B are calculated. These 
correction speeds Vf+ and Vf- are calculated as 
follows . 

25 As described above in the first embodiment, 

Fig. 4 is a graph for explaining a method of 
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calculating the correction speeds Vf+ and Vf-. 
Referring to Fig. 4, the ordinates indicates the 
position of the focus lens; and the abscissa, the 
position of the zoom lens. Reference numeral 1004 
5 denotes a cam locus to be traced. 

Assume that the focusing speed set when the 
position of the focus lens 605 changes by a value y as 
the position of the zoom lens 602 changes by a value x 
is the standard speed VfO (403), and the focusing 

10 speeds set when the position of the focus lens 605 

changes by values n and m as the position of the zoom 
lens 602 changes by the value x are respectively the 
correction speeds Vf+ and Vf- to be obtained. In this 
case, the values n and m are determined such that a 

15 speed 401, which is obtained by adding the correction 
speed Vf+ to the standard speed VfO and is used to 
drive the lens in the + direction, and a speed 402, 
which is obtained by adding the correction speed Vf- 
to the standard speed VfO and is used to drive the 

20 lens in the - direction, respectively have direction 
vectors separated from the direction vector of the 
standard speed VfO by an equal angle 7. 

First of all, the value n and m are obtained. 
According to the graph of Fig. 4, 

25 tan9 = y/x, tan (6 - 7) = (y - m) /x, tan (6 + 7) 

= (y +n) /x ... (6) 
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tan (6 ± 7) = ( tane#tarvy) / (l±tan9*tanY) 



. . . (7) 



According to equations (6) and (7), 



m = (x2 + y2) / (x/K + y) 



. . . (8) 



n = (x2 + y2) / (x/k - y) 



- . . (9) 



5 



for tan7 = k 



Therefore, the value n and m are obtained from 
the equations. 

The angle 7 is changed to 0.8 times the angle on 
the wide-angle side as a reference in the middle 

10 region and to twice the reference angle in the 

telephoto region in accordance with the focal length. 
With this setting, the incrementing/decrementing 
period of the sharpness signal level that changes in 
accordance with the driven state of the focus lens 605 

15 can be kept constant with respect to a predetermined 

focus lens position change amount. This decreases the 
possibility of missing a locus to be traced during 
zooming . 



20 table in the memory of the AF microcomputer 616 in 

correspondence with the value of the angle 7, and is 
read out, as needed, to solve equations (8) and (9) . 
If the position of the zoom lens 602 changes by x per 
unit time, the respective values can be defined as 

25 follows: zoom speed vz = x, standard focusing speed 
VfO = y, correction speed Vf+ = n, and correction 



In this embodiment, a value k is stored in a 
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speed Vf- = m. The correction speeds Vf+ and Vf- can 
be obtained from equations (8) and (9) . 

In step S805, it is checked whether the zoom 
speed set in step S801 is high or low. If high-speed 
5 zooming is determined, the flow advances to step S806 
to substitute the integral value of sharpness signals 
obtained in the vertical sync period for a focus 
evaluation value A to be used for zooming. If low- 
speed zooming is determined, the flow advances to step 

10 S807 to substitute the average of the integral values 
of sharpness signals from the previous vertical sync 
period to the current vertical sync period for the 
focus evaluation value A. 

It is then checked in step S808 whether zooming 

15 is from the wide-angle side to the telephoto side. If 
NO in step S808, the correction speeds are set as Vf+ 
= 0 and Vf- = 0 in step S809, and the flow jumps to 
step S812. If YES in step S808, it is checked in step 
S810 whether the current sharpness signal level (focus 

20 evaluation value A) is lower than a threshold TH1 . If 
NO in step S810, the flow jumps to step S812 . If YES 
in step S810, the reverse flag is set to "1". 

In step S812, it is checked whether the reverse 
flag is at "1". If YES in step S812, it is checked in 

25 step S813 whether the correction flag is at "1". In 
this case, the correction flag indicates whether cam 
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locus tracking is in the + direction or - direction. 
If NO in step S813, the correction flag is set to "1" 
( + direction) in step S816, and the focusing speed Vf 
is set as follows: 
5 Vf = VfO + Vf+ (VfO > 0) 

= VfO - Vf+ (VfO < 0) 
for Vf + > 0 

3 If YES in step S813, the correction flag is set 

J1 to "0" in step S814, and the focusing speed Vf is set 

L: 10 as follows: 

P Vf = VfO - Vf- (VfO > 0) 

,A = VfO + Vf- (VfO < 0) 

□ for Vf- > 0 

U If NO in step S812, i.e., the reverse flag is 

n 15 not at "1", it is checked in step S815, as in step 

S813, whether the correction flag is at "1". If YES in 
step S815, the flow advances to step S816. If NO in 
step S815, the flow advances to step S814 . Finally, 
the focus motor speed Vf is set in step S817 . With the 
20 above operation, the zooming routine in step S705 in 
Fig. 15 is complete. Subsequently, in steps S7 06 and 
S707, the motors are actually driven. 

As described above, according to the third 
embodimient, when the focus position is unknown, and 
25 zooming is performed while the focus evaluation value 
is increased/decreased, a sharpness integral signal 
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(at the current moment) in the current vertical sync 
period is used as the evaluation value in high-speed 
zooming. In low-speed zooming, the average of 
sharpness signal integral values from the previous 
5 vertical sync period to the current vertical sync 
period is used as the evaluation value . With this 
operation, the response characteristics of an 
evaluation signal are improved in high-speed zooming. 
In low-speed zooming, focusing can be performed while 

10 noise due to camera shakes is removed. Therefore, the 
focus tracking performance both in high-speed zooming 
and low-speed zooming can be improved. 
(Fourth Embodiment) 

According to the method of the third embodiment, 

15 as an evaluation signal for focus tracking in zooming 
from the wide-angle side to the telephoto side, a 
sharpness integral signal (at the current moment) in 
the current vertical sync period is used in high-speed 
zooming, whereas the average of sharpness signal 

20 integral values from the previous vertical sync period 
to the current vertical sync period is used as this 
evaluation value in low- speed zooming, thereby 
improving the focus tracking performance in zooming. 

The method of the third embodiment is, however, 

25 associated with only two zoom speeds for high-speed 
zooming and low-speed zooming. In the fourth 
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embodiment, therefore, a method associated with 
multiple zoom speeds will be described. 

Fig. 17 is a flow chart showing a procedure for 
executing this embodiment, and more specifically, the 
5 subroutine in step S705 in Fig. 15. The fourth 

embodiment differs from the third embodiment in that 
the processing in step S905 replaces the processing in 
steps S805 to S807 in Fig. 16. In step S905, an 
average time is determined from an average time table 
10 set in accordance with zoom speeds, and a focus 

evaluation value A is calculated. The following is an 
example of the average time table: 



15 Average Time 3 3 2 2 1 1 (vertical sync period) 

When, for example, the zoom speed is "6", i.e., 
the highest speed, the average time is one vertical 
sync period, and the integral value of sharpness 
signals obtained in the current vertical sync period 

20 is used as the evaluation value A. When the zoom speed 
is "3", i.e., the middle speed, the average of the 
integral values of sharpness signals in two vertical 
sync periods is used as the evaluation value A. When 
the zoom speed is "1", i.e., the lowest speed, the 

25 average of the integral values of sharpness signals in 
three vertical sync periods is used as the evaluation 



Zoom Speed 1 2 3 4 5 6 



low-speed side 



high-speed side 
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value A. Note that this average time may be set to be 
lower than three vertical sync period in accordance 
with the zoom speed. The processing in steps S906 to 
S915 is the same as that in steps S808 to S817 in 
5 Fig. 16. 

As described above, according to the fourth 
embodiment, to calculate the evaluation value A used 
for focusing during zooming, the response 
characteristics of an evaluation value are improved in 

10 high-speed zooming. In low-speed zooming, the average 
time for the integral value of sharpness signals is 
slightly changed in accordance with multiple zoom 
speeds so as to remove noise due to camera shakes and 
the like, thereby obtaining proper evaluation values A 

15 in zooming at various zoom speeds . This can improve 
the precision in in-focus locus selection and focus 
tracking . 

(Fifth Embodiment) 

According to the methods of the third and fourth 
20 embodiments, as an evaluation signal for focus 

tracking during zooming from the wide-angle side to 
the telephoto side, the average of the integral values 
of sharpness signals is used in accordance with the 
zoom speed, thereby removing noise values due to 
25 object changes and changes such as camera shakes. 

In the methods of the third and fourth 



- 57 - 




embodiments, however, since the average time is 
determined in accordance with only the zoom speed, 
when the level of a video signal is low at a low 
illuminance, and electrical noise increases after the 
5 signal is amplified by an amplification circuit, no 
good effect can be obtained. In the fifth embodiment, 
therefore, a method of changing the average time 
P=i required to calculate the evaluation value for focus 

sin- tracking in accordance with illuminance will be 

I— 10 described. 

Fig. 18 is a flow chart showing a procedure for 

■ :e£s 

executing this embodiment, and more specifically, the 
O subroutine in step S705 in Fig. 15. The fifth 

lU embodiment differs from the third embodiment in that 

*n- 15 the processing in steps S1105 to S1107 replaces the 

processing in steps S805 to S807 in Fig. 16. 

In step S1105, it is checked, on the basis of 
the magnitude of the luminance signal obtained by a 
CCD 606 in Fig. 13, whether the illuminance is low. If 
20 the luminance signal is smaller than a predetermined 
value, it is determined that the illuminance is low, 
and vice versa. If YES in step S1105, the average of 
the integral values of sharpness signals in only 
predetermined vertical sync periods is set as an 
25 evaluation value A. 

If NO in step S1105, a sharpness integral signal 
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in the current the vertical sync period is set as the 
evaluation value A. The processing in the subsequent 
steps, i.e., steps S1108 to S1117, is the same as that 
in steps S808 to S817 in Fig. 16. 
5 As described above, according to the fifth 

embodiment, when the evaluation value A for focusing 
during zooming is to be generated, an appropriate 
evaluation value A free from electrical noise can be 
obtained by changing the average time for the integral 
10 value of sharpness signals in accordance with 
illuminance information. This can improve the 
performance in in-focus locus selection and focus 
tracking . 

(Sixth Embodiment) 

15 According to the methods of the third and fourth 

embodiments, as an evaluation signal for focus 
tracking during zooming from the wide-angle side to 
the telephoto side, the average of sharpness integral 
signals is used in accordance with the zoom speed. The 

20 methods of the third and fourth embodiments, however, 
are mainly effective when changes in sharpness signal 
are caused by only object changes and movement of the 
lens. When, for example, the level of a sharpness 
integral signal decreases owing to external noise due 

25 to camera shakes and the like, the signal undergoes a 

complicated change. In the sixth embodiment, therefore, 
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a method of changing the average time for a sharpness 
integral signal in accordance with external 
information such as camera shake information will be 
described. 

5 Fig. 19 shows the characteristic feature of an 

image sensing apparatus of this embodiment. Fig. 20 is 
a flow chart showing a procedure for executing the 
embodiment, and more specifically, the subroutine in 
step S705 in Fig. 15. The sixth embodiment differs 

10 from the third embodiment in that the arrangement of 
the sixth embodiment in Fig. 19 includes a shake 
detection means 1201 using an angular speed sensor, 
acceleration sensor, or the like in addition to the 
arrangement in Fig. 13, and the processing in steps 

15 S1305 to S1307 replaces the processing in steps S805 
to S807 in Fig. 16. 

In step S13 05 in Fig. 20, it is checked whether 
camera shake information is obtained by the shake 
detection means 1201 in Fig. 19. If YES in step S1305, 

20 the flow advances to step S1306 to set the average of 
sharpness integral values in only predetermined 
vertical sync periods as the evaluation value A. If NO 
in step S1305, a sharpness integral signal in the 
current vertical sync period is set as the evaluation 

25 value A. The processing in the subsequent steps, i.e., 
steps S13 08 to S1317, is the same as that in steps 
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S808 to S817 in Fig. 16. 

As described above, according to the sixth 
embodiment, when the evaluation value A for focusing 
during zooming is to be generated, an appropriate 
5 evaluation value A free from noise due to camera 

shakes can be obtained by changing the average time 
for the integral value of sharpness signals in 
13 accordance with the camera shake information. This can 

jjj improve the performance in in-focus locus selection 

iff 

m 10 and focus tracking. 

I\T As described above, according to the third to 

ras sixth embodiments, when the focus lens tracks the 

y object while the sharpness signal level is 

lU increased/decreased during zooming, sharpness signals 

15 are averaged while the average time for the sharpness 
signals is changed in accordance with the zoom speed. 
With this operation, the movement of the focus lens 
can be controlled in accordance with the focus 
evaluation value corresponding to the zoom speed set 
20 at this time, thereby improving the in-focus locus 
selection performance and tracking performance with 
respect to a change in locus in zooming. 

In addition, when the focus lens tracks the 
object while the sharpness signal level is 
25 increased/decreased during zooming, the average of 
sharpness signals is made variable by changing the 
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average time for the sharpness signals in accordance 
with the illuminance on the object. With this 
operation, the movement of the focus lens can be 
controlled in accordance with a focus evaluation value 
5 corresponding to the illuminance on the object 

photographed at this time, thereby improving the in- 
focus locus selection performance and tracking 

ri performance with respect to a change in locus in 

jijjl zooming. 

«U 10 Furthermore, when the focus lens tracks the 

object while the sharpness signal level is 
^ increased/decreased during zooming, the average of 

y sharpness signals is made variable by changing the 

lU average time for the sharpness signals in accordance 

=3 15 with external information such as camera shake 

information. With this operation, the movement of the 
focus lens can be controlled in accordance with the 
focus evaluation value corresponding to the 
presence /absence of camera shakes, thereby improving 
20 the in- focus locus selection performance and tracking 
performance with respect to external noise during 
zooming . 

Note that the image sensing apparatus according 
to each embodiment of the present invention can be 
25 applied to various types of cameras such as a video 

camera, VTR, and digital video camera. The functions 
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m 



of the respective embodiments described above are 
mainly implemented by control operation performed by 
the AF microcomputer and the system controller. This 
control operation is performed in accordance with a 
5 program stored in a recording medium (not shown) . 

In this case, the program itself realizes the 
functions of the above-mentioned embodiments, and the 
program itself and a means for supplying the program 
to the computer, e.g., a storage medium which stores 

10 the program code, constitute the present invention. As 
the storage medium for storing the program, for 
example, a floppy disk, hard disk, optical disk, 
magneto-optical disk, CD-ROM, magnetic tape, 
nonvolatile memory card, ROM, and the like may be used. 

15 The present invention is not limited to the 

above embodiments and various changes and 
modifications can be made within the spirit and scope 
of the present invention. Therefore, to apprise the 
public of the scope of the present invention the 

20 following claims are made. 
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